Internet of Robotic Things Intelligent Connectivity and Platforms

The Internet of Things (IoT) and Industrial IoT (IIoT) have developed rapidly in the past few years, as both the Internet and “things” have evolved significantly. “Things” now range from simple Radio Frequency Identification (RFID) devices to smart wireless sensors, intelligent wireless sensors and actuators, robotic things, and autonomous vehicles operating in consumer, business, and industrial environments. The emergence of “intelligent things” (static or mobile) in collaborative autonomous fleets requires new architectures, connectivity paradigms, trustworthiness frameworks, and platforms for the integration of applications across different business and industrial domains. These new applications accelerate the development of autonomous system design paradigms and the proliferation of the Internet of Robotic Things (IoRT). In IoRT, collaborative robotic things can communicate with other things, learn autonomously, interact safely with the environment, humans and other things, and gain qualities like self-maintenance, self-awareness, self-healing, and fail-operational behavior. IoRT applications can make use of the individual, collaborative, and collective intelligence of robotic things, as well as information from the infrastructure and operating context to plan, implement and accomplish tasks under different environmental conditions and uncertainties. The continuous, real-time interaction with the environment makes perception, location, communication, cognition, computation, connectivity, propulsion, and integration of federated IoRT and digital platforms important components of new-generation IoRT applications. This paper reviews the taxonomy of the IoRT, emphasizing the IoRT intelligent connectivity, architectures, interoperability, and trustworthiness framework, and surveys the technologies that enable the application of the IoRT across different domains to perform missions more efficiently, productively, and completely. The aim is to provide a novel perspective on the IoRT that involves communication among robotic things and humans and highlights the convergence of several technologies and interactions between different taxonomies used in the literature.publishedVersio

AI-Based Edge Acquisition, Processing and Analytics for Industrial Food Production

This article presents a novel approach to the acquisition, processing, and analytics of industrial food production by employing state-of-the-art artificial intelligence (AI) at the edge. Intelligent Industrial Internet of Things (IIoT) devices are used to gather relevant production parameters of industrial equipment and motors, such as vibration, temperature and current using built-in and external sensors. Machine learning (ML) is applied to measurements of the key parameters of motors and equipment. It runs on edge devices that aggregate sensor data using Bluetooth, LoRaWAN, and Wi-Fi communication protocols. ML is embedded across the edge continuum, powering IIoT devices with anomaly detectors, classifiers, predictors, and neural networks. The ML workflows are automated, allowing them to be easily integrated with more complex production flows for predictive maintenance (PdM). The approach proposes a decentralized ML solution for industrial applications, reducing bandwidth consumption and latency while increasing privacy and data security. The system allows for the continuous monitoring of parameters and is designed to identify potential breakdown situations and alert users to prevent damage, reduce maintenance costs and increase productivity.publishedVersio

Automotive Intelligence Embedded in Electric Connected Autonomous and Shared Vehicles Technology for Sustainable Green Mobility

The automotive sector digitalization accelerates the technology convergence of perception, computing processing, connectivity, propulsion, and data fusion for electric connected autonomous and shared (ECAS) vehicles. This brings cutting-edge computing paradigms with embedded cognitive capabilities into vehicle domains and data infrastructure to provide holistic intrinsic and extrinsic intelligence for new mobility applications. Digital technologies are a significant enabler in achieving the sustainability goals of the green transformation of the mobility and transportation sectors. Innovation occurs predominantly in ECAS vehicles’ architecture, operations, intelligent functions, and automotive digital infrastructure. The traditional ownership model is moving toward multimodal and shared mobility services. The ECAS vehicle’s technology allows for the development of virtual automotive functions that run on shared hardware platforms with data unlocking value, and for introducing new, shared computing-based automotive features. Facilitating vehicle automation, vehicle electrification, vehicle-to-everything (V2X) communication is accomplished by the convergence of artificial intelligence (AI), cellular/wireless connectivity, edge computing, the Internet of things (IoT), the Internet of intelligent things (IoIT), digital twins (DTs), virtual/augmented reality (VR/AR) and distributed ledger technologies (DLTs). Vehicles become more intelligent, connected, functioning as edge micro servers on wheels, powered by sensors/actuators, hardware (HW), software (SW) and smart virtual functions that are integrated into the digital infrastructure. Electrification, automation, connectivity, digitalization, decarbonization, decentralization, and standardization are the main drivers that unlock intelligent vehicles' potential for sustainable green mobility applications. ECAS vehicles act as autonomous agents using swarm intelligence to communicate and exchange information, either directly or indirectly, with each other and the infrastructure, accessing independent services such as energy, high-definition maps, routes, infrastructure information, traffic lights, tolls, parking (micropayments), and finding emergent/intelligent solutions. The article gives an overview of the advances in AI technologies and applications to realize intelligent functions and optimize vehicle performance, control, and decision-making for future ECAS vehicles to support the acceleration of deployment in various mobility scenarios. ECAS vehicles, systems, sub-systems, and components are subjected to stringent regulatory frameworks, which set rigorous requirements for autonomous vehicles. An in-depth assessment of existing standards, regulations, and laws, including a thorough gap analysis, is required. Global guidelines must be provided on how to fulfill the requirements. ECAS vehicle technology trustworthiness, including AI-based HW/SW and algorithms, is necessary for developing ECAS systems across the entire automotive ecosystem. The safety and transparency of AI-based technology and the explainability of the purpose, use, benefits, and limitations of AI systems are critical for fulfilling trustworthiness requirements. The article presents ECAS vehicles’ evolution toward domain controller, zonal vehicle, and federated vehicle/edge/cloud-centric based on distributed intelligence in the vehicle and infrastructure level architectures and the role of AI techniques and methods to implement the different autonomous driving and optimization functions for sustainable green mobility.publishedVersio

An Intelligent Real-Time Edge Processing Maintenance System for Industrial Manufacturing, Control, and Diagnostic

This paper presents an artificial intelligence (AI) based edge processing real-time maintenance system for the purposes of industrial manufacturing control and diagnostics. The system is evaluated in a soybean processing manufacturing facility to identify abnormalities and possible breakdown situations, prevent damage, reduce maintenance costs, and increase production productivity. The system can be used in any other manufacturing or chemical processing facility that make use of motors rotating equipment in different process phases. The system combines condition monitoring, fault detection, and diagnosis using machine learning (ML) and deep learning (DL) algorithms. These algorithms are used with data resulting from the continuous monitoring of relevant production equipment and motor parameters, such as temperature, vibration, sound/noise, and current/voltage. The condition monitoring integrates intelligent Industrial Internet of Things (IIoT) devices with multiple sensors combined with AI-based techniques and edge processing. This is done to identify the parameter modifications and distinctive patterns that occur before a failure and predict forthcoming failure modes before they arise. The data from production equipment/motors is collected wirelessly using different communication protocols - such as Bluetooth low energy (BLE), Long range wide area network (LoRaWAN), and Wi-Fi - and aggregated into an edge computing processing unit via several gateways. The AI-based algorithms are embedded in the processing unit at the edge, allowing the prediction and intelligent control of the production equipment/motor parameters. IIoT devices for environmental sensing, vibration, temperature monitoring, and sound/ultrasound detection are used with embedded signal processing that runs on an ARM Cortex-M4 microcontroller. These devices are connected through either wired or wireless protocols. The system described addresses the components necessary for implementing the predictive maintenance (PdM) strategy in soybean industrial processing manufacturing environments. Additionally, it includes new elements that broaden the possibilities for prescriptive maintenance (PsM) developments to be made. The type of ML or DL techniques and algorithms used in maintenance modeling is dictated by the application and available data. The approach presented combines multiple data sources that improve the accuracy of condition monitoring and prediction. DL methods further increase the accuracy and require interpretable and efficient methods as well as the availability of significant amounts of (labeled) data.publishedVersio

The Western Denmark Cardiac Computed Tomography Registry:a review and validation study

BACKGROUND: As a subregistry to the Western Denmark Heart Registry (WDHR), the Western Denmark Cardiac Computed Tomography Registry (WDHR-CCTR) is a clinical database established in 2008 to monitor and improve the quality of cardiac computed tomography (CT) in Western Denmark. OBJECTIVE: We examined the content, data quality, and research potential of the WDHR-CCTR. METHODS: We retrieved 2008–2012 data to examine the 1) content; 2) completeness of procedure registration using the Danish National Patient Registry as reference; 3) completeness of variable registration comparing observed vs expected numbers; and 4) positive predictive values as well as negative predictive values of 19 main patient and procedure variables. RESULTS: By December 31, 2012, almost 22,000 cardiac CTs with up to 40 variables for each procedure have been registered. Of these, 87% were coronary CT angiography performed in patients with symptoms indicative of coronary artery disease. Compared with the Danish National Patient Registry, the overall procedure completeness was 72%. However, an additional medical record review of 282 patients registered in the Danish National Patient Registry, but not in the WDHR-CCTR, showed that coronary CT angiographies accounted for only 23% of all nonregistered cardiac CTs, indicating >90% completeness of coronary CT angiographies in the WDHR-CCTR. The completeness of individual variables varied substantially (range: 0%–100%), but was >85% for more than 70% of all variables. Using medical record review of 250 randomly selected patients as reference standard, the positive predictive value for the 19 variables ranged from 89% to 100% (overall 97%), whereas the negative predictive value ranged from 97% to 100% (overall 99%). Stratification by center status showed consistently high positive and negative predictive values for both university (96%/99%) and nonuniversity centers (97%/99%). CONCLUSION: WDHR-CCTR provides ongoing prospective registration of all cardiac CTs performed in Western Denmark since 2008. Overall, the registry data have a high degree of completeness and validity, making it a valuable tool for clinical epidemiological research

Prediction of Coronary Revascularization in Stable Angina: Comparison of FFRCT With CMR Stress Perfusion Imaging.

OBJECTIVES: This study was designed to compare head-to-head fractional flow reserve (FFR) derived from coronary computed tomography angiography (CTA) (FFRCT) and cardiac magnetic resonance (CMR) stress perfusion imaging for prediction of standard-of-care-guided coronary revascularization in patients with stable chest pain and obstructive coronary artery disease by coronary CTA. BACKGROUND: FFRCT is a novel modality for noninvasive functional testing. The clinical utility of FFRCT compared to CMR stress perfusion imaging in symptomatic patients with coronary artery disease is unknown. METHODS: Prospective study of patients (n=110) with stable angina pectoris and 1 or more coronary stenosis ≥50% by coronary CTA. All patients underwent invasive coronary angiography. Revascularization was FFR-guided in stenoses ranging from 30% to 90%. FFRCT ≤0.80 in 1 or more coronary artery or a reversible perfusion defect (≥2 segments) by CMR categorized patients with ischemia. FFRCT and CMR were analyzed by core laboratories blinded for patient management. RESULTS: A total of 38 patients (35%) underwent revascularization. Per-patient diagnostic performance for identifying standard-of-care-guided revascularization, (95% confidence interval) yielded a sensitivity of 97% (86 to 100) for FFRCT versus 47% (31 to 64) for CMR, p  0.05, respectively. CONCLUSIONS: In patients with stable chest pain referred to invasive coronary angiography based on coronary CTA, FFRCT and CMR yielded similar overall diagnostic accuracy. Sensitivity for prediction of revascularization was highest for FFRCT, whereas specificity was highest for CMR.Danish Heart Foundation (grant no. 15-R99-A5837-22920)Health Research Fund of Central Denmark Regio

Automotive Intelligence Embedded in Electric Connected Autonomous and Shared Vehicles Technology for Sustainable Green Mobility

The automotive sector digitalization accelerates the technology convergence of perception, computing processing, connectivity, propulsion, and data fusion for electric connected autonomous and shared (ECAS) vehicles. This brings cutting-edge computing paradigms with embedded cognitive capabilities into vehicle domains and data infrastructure to provide holistic intrinsic and extrinsic intelligence for new mobility applications. Digital technologies are a significant enabler in achieving the sustainability goals of the green transformation of the mobility and transportation sectors. Innovation occurs predominantly in ECAS vehicles’ architecture, operations, intelligent functions, and automotive digital infrastructure. The traditional ownership model is moving toward multimodal and shared mobility services. The ECAS vehicle’s technology allows for the development of virtual automotive functions that run on shared hardware platforms with data unlocking value, and for introducing new, shared computing-based automotive features. Facilitating vehicle automation, vehicle electrification, vehicle-to-everything (V2X) communication is accomplished by the convergence of artificial intelligence (AI), cellular/wireless connectivity, edge computing, the Internet of things (IoT), the Internet of intelligent things (IoIT), digital twins (DTs), virtual/augmented reality (VR/AR) and distributed ledger technologies (DLTs). Vehicles become more intelligent, connected, functioning as edge micro servers on wheels, powered by sensors/actuators, hardware (HW), software (SW) and smart virtual functions that are integrated into the digital infrastructure. Electrification, automation, connectivity, digitalization, decarbonization, decentralization, and standardization are the main drivers that unlock intelligent vehicles' potential for sustainable green mobility applications. ECAS vehicles act as autonomous agents using swarm intelligence to communicate and exchange information, either directly or indirectly, with each other and the infrastructure, accessing independent services such as energy, high-definition maps, routes, infrastructure information, traffic lights, tolls, parking (micropayments), and finding emergent/intelligent solutions. The article gives an overview of the advances in AI technologies and applications to realize intelligent functions and optimize vehicle performance, control, and decision-making for future ECAS vehicles to support the acceleration of deployment in various mobility scenarios. ECAS vehicles, systems, sub-systems, and components are subjected to stringent regulatory frameworks, which set rigorous requirements for autonomous vehicles. An in-depth assessment of existing standards, regulations, and laws, including a thorough gap analysis, is required. Global guidelines must be provided on how to fulfill the requirements. ECAS vehicle technology trustworthiness, including AI-based HW/SW and algorithms, is necessary for developing ECAS systems across the entire automotive ecosystem. The safety and transparency of AI-based technology and the explainability of the purpose, use, benefits, and limitations of AI systems are critical for fulfilling trustworthiness requirements. The article presents ECAS vehicles’ evolution toward domain controller, zonal vehicle, and federated vehicle/edge/cloud-centric based on distributed intelligence in the vehicle and infrastructure level architectures and the role of AI techniques and methods to implement the different autonomous driving and optimization functions for sustainable green mobility

An Intelligent Real-Time Edge Processing Maintenance System for Industrial Manufacturing, Control, and Diagnostic

This paper presents an artificial intelligence (AI) based edge processing real-time maintenance system for the purposes of industrial manufacturing control and diagnostics. The system is evaluated in a soybean processing manufacturing facility to identify abnormalities and possible breakdown situations, prevent damage, reduce maintenance costs, and increase production productivity. The system can be used in any other manufacturing or chemical processing facility that make use of motors rotating equipment in different process phases. The system combines condition monitoring, fault detection, and diagnosis using machine learning (ML) and deep learning (DL) algorithms. These algorithms are used with data resulting from the continuous monitoring of relevant production equipment and motor parameters, such as temperature, vibration, sound/noise, and current/voltage. The condition monitoring integrates intelligent Industrial Internet of Things (IIoT) devices with multiple sensors combined with AI-based techniques and edge processing. This is done to identify the parameter modifications and distinctive patterns that occur before a failure and predict forthcoming failure modes before they arise. The data from production equipment/motors is collected wirelessly using different communication protocols - such as Bluetooth low energy (BLE), Long range wide area network (LoRaWAN), and Wi-Fi - and aggregated into an edge computing processing unit via several gateways. The AI-based algorithms are embedded in the processing unit at the edge, allowing the prediction and intelligent control of the production equipment/motor parameters. IIoT devices for environmental sensing, vibration, temperature monitoring, and sound/ultrasound detection are used with embedded signal processing that runs on an ARM Cortex-M4 microcontroller. These devices are connected through either wired or wireless protocols. The system described addresses the components necessary for implementing the predictive maintenance (PdM) strategy in soybean industrial processing manufacturing environments. Additionally, it includes new elements that broaden the possibilities for prescriptive maintenance (PsM) developments to be made. The type of ML or DL techniques and algorithms used in maintenance modeling is dictated by the application and available data. The approach presented combines multiple data sources that improve the accuracy of condition monitoring and prediction. DL methods further increase the accuracy and require interpretable and efficient methods as well as the availability of significant amounts of (labeled) data